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Abstract 

In this lecture we briefly review the definition, consequences and appli- 
cations of an entropy, S q , which generalizes the usual Boltzmann-Gibbs 
entropy Sbg (Si = Sbg), basis of the usual statistical mechanics, well 
known to be applicable whenever ergodicity is satisfied at the microscopic 
dynamical level. Such entropy S q is based on the notion of q-exponential 
and presents properties not shared by other available alternative general- 
izations of Sbg- The thermodynamics proposed in this way is generically 
nonextensive in a sense that will be qualified. The present framework 
seems to describe quite well a vast class of natural and artificial systems 
which are not ergodic nor close to it. The a priori calculation of q is nec- 
essary to complete the theory and we present some models where this has 
already been achieved. 
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1 Introduction 



Entropy emerges as a classical thermodynamical concept in the 19th century 
with Clausius but it is only due to the work of Boltzmann and Gibbs that the 
idea of entropy becomes a cornerstone of statistical mechanics. As result we 
have that the entropy S of a system is given by the so called Boltzmann-Gibbs 
(BG) entropy 

w 

Sbg = -k^Pilrtpi (1) 

i=l 

with the normalization condition 

w 

£ft = 1 - (2) 

i=l 

Here pi is the probability for the system to be in the i-th microstate, and k is an 
arbitrary constant that, in the framework of thermodynamics, is taken to be the 
Boltzmann constant (ks = 1.38 x 10 -23 J/K). Without loss of generality one can 
also arbitrarily assume k = 1. If every microstate has the same probability pi = 
1/W (equiprobability assumption) one obtains the famous Boltzmann principle 

S BG = k\nW. (3) 

It can be easily shown that entropy Q is nonnegative, concave, extensive 
and stable pQ| (or experimentally robust). By extensive we mean the fact that, 
if A and B are two independent systems in the sense that pf 3 +B = pfpf > then 
we straightforwardly verify that 

S BG ( A + B) = S BG ( A) + S BG (B) . (4) 

Stability will be addressed later on. One might naturally expect that the form 
{Q of Sbg would be rigorously derived from microscopic dynamics. However, 
the difficulty of performing such a program can be seen from the fact that still 
today this has not yet been accomplished from first principles. Consequently 
l(T|l is in practice a postulate. To better realize this point, let us place it on some 
historical background. 

Albert Einstein says in 1910 
" In order to calculate W, one needs a complete (molecular-mechanical) theory of 
the system under consideration. Therefore it is dubious whether the Boltzmann 
principle has any meaning without a complete molecular mechanical theory 
or some other theory which describes the elementary processes. S = k In W + 
constant seems without content, from a phenomenological point of view, without 
giving in addition such an Elementartheorie." . 

In his famous book Thermodynamics, Enrico Fermi says in 1936 [Sj: 
"The entropy of a system composed of several parts is very often equal to the 
sum of the entropies of all the parts. This is true if the energy of the system is 
the sum of the energies of all the parts and if the work performed by the system 
during a transformation is equal to the sum of the amounts of work performed 
by all the parts. Notice that these conditions are not quite obvious and that in 
some cases they may not be fulfilled." . 
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Laszlo Tisza says in 1961 0]: 
"The situation is different for the additivity postulate P a2, the validity of 
which cannot be inferred from general principles. We have to require that 
the interaction energy between thermodynamic systems be negligible. This 
assumption is closely related to the homogeneity postulate P dl. From the 
molecular point of view, additivity and homogeneity can be expected to be 
reasonable approximations for systems containing many particles, provided that 
the intramolecular forces have a short range character.". 

Peter Landsberg says in 1978 
"The presence of long-range forces causes important amendments to thermody- 
namics, some of which are not fully investigated as yet." . 

If we put all this together, as well as many other similar statements avail- 
able in the literature, we may conclude that physical entropies different from 
the BG one could exist which would be the appropriate ones for anomalous 
systems. Among the anomalies that we may focus on we include (i) metaequi- 
librium (metastable) states in large systems involving long range forces between 
particles, (ii) metaequilibrium states in small systems, i.e., whose number of 
particles is relatively small, say up to 100-200 particles, (hi) glassy systems, (iv) 
some classes of dissipative systems, (v) mesoscopic systems with nonmarkovian 
memory, and others which, in one way or another, might violate the usual sim- 
ple ergodicity. Such systems might have a multifractal, scale-free or hierarchical 
structure in their phase space. 

In this spirit, an entropy, S q , which generalizes Sbg, has been proposed in 
1988 P| as the basis for generalizing BG statistical mechanics. The entropy 
S q (with Si = Sbg) depends on the index q, a real number to be determined 
a priori from the microscopic dynamics. This entropy seems to describe quite 
well a large number of natural and artificial systems. As we shall see, the 
property chosen to be generalized is extensivity, i.e., Eq. In this lecture we 
will introduce, through a metaphor, the form of S q , and will then describe its 
properties and applications as they have emerged during the last 15 years. 

A clarification might be worthy. Why introducing S q through a metaphor, 
why not deducing it? If we knew how to deduce Sbg from first principles for 
those systems (e.g., short-range-interacting Hamiltonian systems) whose micro- 
scopic dynamics ultimately leads to ergodicity, we could try to generalize along 
that path. But this procedure is still unknown, the form Q being adopted, 
as we already mentioned, at the level of a postulate. It is clear that we are 
then obliged to do the same for any generalization of it. Indeed, there is no 
logical/deductive way to generalize any set of postulates that are useful for the- 
oretical physics. The only way to do that is precisely through some kind of 
metaphor. 

A statement through which we can measure the difficulty of (rigorously) 
making the main features of BG statistical mechanics to descend from (nonlin- 
ear) dynamics is that of the mathematician Floris Takens. He said in 1991 
"The values of pi are determined by the following dogma: if the energy of the 
system in the i th state is Ei and if the temperature of the system is T then: 
Pi = exp{-£ , l /fcT}/Z(T), where Z{T) = ^ 4 cxp{-£ 4 /fcT}, (this last constant 
is taken so that YliPi = This choice of pi is called Gibbs distribution. We 
shall give no justification for this dogma; even a physicist like Ruelle disposes 
of this question as "deep and incompletely clarified" . " 

It is a tradition in mathematics to use the word "dogma" when no theorem is 
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available. Perplexing as it might be for some readers, no theorem is available 
which establishes, on detailed microscopic dynamical grounds, the necessary 
and sufficient conditions for being valid the use of the celebrated BG factor. We 
may say that, at the bottom line, this factor is ubiquitously used in theoretical 
sciences because seemingly "it works" extremely well in an enormous amount of 
cases. It just happens that more and more systems (basically the so called com- 
plex systems) are being identified nowadays where that statistical factor seems 
to not "work"! 



2 Mathematical properties 
2.1 A metaphor 

The simplest ordinary differential equation one might think of is 

whose solution (with initial condition y(0) = 1) is y = 1. The next simplest 
differential equation might be thought to be 

T = 1 ' (6) 

ax 

whose solution, with the same initial condition, is y = 1 + x. The next one in 
increasing complexity that we might wish to consider is 

dy frf . 

whose solution is y — e x . Its inverse function is 

y = Inx , (8) 

which has the same functional form of the Boltzmann-Gibbs entropy @, and 
satisfies the well known additivity property 

\ii(xaXb) = hiXA + Itixb- (9) 

A question that might be put is: can we unify all three cases (!">!( il 71) considered 
above? A trivial positive answer would be to consider dy/dx = a + by, and play 
with (a, b). Can we unify with only one parameter? The answer still is positive, 
but this time out of linearity, namely with 

% = y q (qeK), (10) 

which, for q — > — oo, q — and q = 1, reproduces respectively the differential 
equations J^J, J^J and |7|. The solution of 1)10(1 is given by the q-exponential 
function 

y=[l + (l-q)x]^= t % (e? = e*), (11) 
whose inverse is the q-logarithm function 
x x ~ q — 1 

y = — = hig x (Irii x = lna;). (12) 

This function satisfies the pseudo-additivity property 

h\ q (x A x B ) = ln 9 x A + ln 9 x B + (1 - <7)(ln ? x A ){^- q x B ) (13) 
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2.2 The nonextensive entropy S q 

We can rewrite Eq. P in a slightly different form, namely (with k = 1) 

w w 

Pi In 

Pi \ Pi 



~>BG 



W W 1 / 1 \ 

^p 4 ln K =^p 4 ln- = (in-) , (14) 



i=l i=l 



where (...) = The quantity ln(l/pi) is sometimes called surprise or 

unexpectedness. Indeed, pi = 1 corresponds to certainty, hence zero surprise if 
the expected event does occur; on the other hand, pi — > corresponds to nearly 
impossibility, hence infinite surprise if the unexpected event does occur. If wc 
introduce the q-surprise (or q-unexpectedness) as ln q (l/pi), it is kind of natural 
to define the following g-entropy 

/ i \ w 1 1 _ q 

In the limit q — > 1 one has pf = pe^ 9-1 - 1 lnpi ~ Pi[l + (q — l)lnpj], and the 
entropy S q coincides with the Boltzmann-Gibbs one, i.e., Si — Sbg- Assuming 
equiprobability (i.e., pi — 1/T4 7 ) one obtains straightforwardly 

W^ q - 1 

S = = ln„ W. (16) 

1-9 

Consequently, it is clear that S q is a generalization of and not an alterna- 
tive to the Boltzmann-Gibbs entropy. The pseudo-additivity of the q-logarithm 
immediately implies (for the following formula we restore arbitrary k) 

S q {A + B) _S q {A) | S q (B) | S q (A)S q (B) 

bt Li is* Is* 

i\j n, i\j hi rv 

if A and B are two independent systems (i.e., pfj +B = pfpf)- It follows that q — 
1, q < 1 and q > 1 respectively correspond to the extensive, superextensive and 
subextensive cases. It is from this property that the corresponding generalization 
of the BG statistical mechanics is often referred to as nonextensive statistical 
mechanics. 

Eq. (|17f) is true under the hypothesis of independency between A and B. 
But if they are correlated in some special, strong way, it may exist q* such that 

S g *(A + B) = S g *(A) + S q .(B) , (18) 

thus recovering extensivity, but of a different entropy, not the usual one! Let us 
illustrate this interesting point through two examples: 

(i) A system of N nearly independent elements yields W(N) ~ (with 
/i > 1) (e.g., fi = 2 for a coin, /i = 6 for a dice). Its entropy S q is given by 

u N(l-q) _ i 

S q (N) = In, W(N) ~ i g (19) 

and extensivity is obtained if and only if q = 1. In other words, Si(N) ~ 
N In /i oc N. This is the usual case, discussed in any textbook. 



■5 



(ii) A system whose elements are correlated at all scales might correspond 
to W(N) ~ N p (with p > 0). Its entropy S q is given by 

mp0--q) - 1 

S,(JV) = In, W(N) — (20) 

and extensivity is obtained if and only if q — q* = 1 — ~ < 1 . In other 
words, S q * (N) oc N. It is allowed to think that such possibility could please 
as much as the usual one (present example (i)) somebody — like Clausius — 
wearing the "glasses" of classical thermodynamics! Indeed, it does not seem that 
Clausius had in mind any specific functional form for the concept of entropy he 
introduced, but he was surely expecting it to be proportional to N for large 
N. We see, in both examples that we have just analyzed, that it can be so. In 
particular, the entropy S q is nonextensive for independent systems, but can be 
extensive for systems whose elements are highly correlated. 

2.3 The 1988 derivation of the entropy S q 

Let us point out that the 1988 derivation jH] of the entropy S q was slightly 
different. If we consider < pi < 1 and q > we have that pf ^ pi if q ?s 1 and 
p\ = pi if q = 1. Many physical phenomena seem to be controlled either by the 
rare events or the common events. Similarly to what occurs in multifractals, one 
could take such effect into account by choosing q < 1 (hence low probabilities 
are enhanced and high probabilities are depressed] indeed, lim Pi _»oPi lv% ~ * °°) 
or q > 1 (hence the other way around] indeed, limp^oP? I Pi = 0)- The present 
index q is completely different from the multifractal index (currently noted 
in the nonextensive statistical literature to avoid confusion, where M stands for 
multifractal), but the type of bias is obviously analogous. What happens then 
if we introduce this type of bias into the entropy itself? 

At variance with the concept of energy, the entropy should not depend on 
the physical support of the information, hence it must be invariant under per- 
mutations of the events. The most natural choice is then to make it depend on 
Y^iLi Pi ■ The simplest dependence being the linear one, one might propose S q = 
A + B X}»=i Pi • ^ some event has Pi = 1 we have certainty, and we consequently 
expect S q = 0, hence A + B = 0, hence S({ Pl }) = A(l - £i=iPf)- We impose 
now Si = Sbg and, taking into account p\ = pie^' 1 ^ lnpi ~ pt[l + (q — 1) lnpj], 
we obtain Si ~ — A(q — 1) Yl^Li Pi m Pi- So we choose A = and straightfor- 
wardly reobtain (|15|l . 

2.4 S q and the Shannon-Khinchin axioms 

Shannon in 1948 and then Khinchin in 1953 gave quite similar sets of ax- 
ioms about the form of the entropic functional (|Hl,|Sj)- Under reasonable re- 
quests about entropy they obtained that the only functional form allowed is the 
Boltzmann-Gibbs entropy. 

Shannon theorem: 

1. S(pi, ...,pyy) continuous function with respect to all its arguments 
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2. S(pi = P2 = ■■■ = pw = w) monotonically increases with W 



W > 

3. S(A + B) = S{A) + S(B) if pf+ B = pfpf 



4. S(p x , = S( Pl , P m)+PlS(^, ^)+Pm5(^, where 



W = W L + W M , Pl = Y,i=iPi> Pm = T,i=w L +iP* (hence p L + p M = 1) 
if and only if S(jp\, ...,pw) is given by Eq. (1). 

Khinchin theorem: 

1. S(p±, ...,pw) continuous function with respect to all its arguments 

2. S(pi = P2 = ■■■ = Pw = w) monotonically increases with W 

3. 5(pi, ...,pw,0) = S(pi, ...,pw) 

4. S(A + B) = S{A) + S(B\A), S(B\A) being the conditional entropy 
if and only if S{pi,..., pw ) is given by Eq. ( 1 ) . 

The following generalizations of these theorems have been given by Santos in 
1997 ^01 and by Abe in 2000 The latter was first conjectured by Plastino 
and Plastino in 1996 jE] and 1999 [H]. 

Santos theorem: 

1. S(j>\, ...,pw) continuous function with respect to all its arguments 

2. S(pi = P2 = ■■■ = Pw = pj/) monotonically increases with W 

o S(A+B) _ S(A) S(B) ( , n] S q (A)S q (B) . f A+B _ A n B 
k - ~k~ k + ( L q )~k k~ 11 P i] ~ Pi Pj 

4. Sfa, ..., Pw ) = S(p L , PM )+plS(^, &L) where 

W = W L + W M , PL = Ei=lPi! PM = Y,i=WL+lPi ( hence PL+PM = 1) 

if and only if 

S{p 1 ,...,p w ) = k ^ (21) 

Abe theorem: 

1. S(p\, ...,pw) continuous function with respect to all its arguments 

2. S(p\ — P2 = ■■■ = pw = monotonically increases with W 

3. S(px, ...,pw,0) = S(pi, ...,pw) 

4. = M + MM +( i_^3M : S (B\A) being the conditional 
entropy 

if and only if S{p\, ...,pw) is given by Eq. (21). 

The Santos and the Abe theorems clearly are important. Indeed, they show 
that the entropy S q is the only possible entropy that extends the Boltzmann- 
Gibbs entropy maintaining the basic properties but allowing, if q ^ 1, nonex- 
tensivity (of the form of Santos' third axiom, or Abe's fourth axiom). 
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2.5 Other mathematical properties 



Reaction under bias: It has been shown ^1] that the Boltzmann-Gibbs 
entropy can be rewritten as 



Sbg = 



a w 

1=1 



(22) 



x=l 



This can be seen as a reaction to a translation of the bias x in the same way as 
differentiation can be seen as a reaction of a function under a (small) translation 
of the abscissa. Along the same line, the entropy S q can be rewritten as 



w 



where 



Dgh(x) 



i=l 

hiqx) h{x) (dm*) dh(x) 



(23) 



(24) 



qx — x \ dx 

is the Jackson's 1909 generalized derivative, which can be seen as a reaction of 
a function under dilatation of the abscissa (or under a finite increment of the 
abscissa). 



Concavity: If we consider two probability distributions {pi} and {p^} for a 
given system (i = 1, W), we can define the convex sum of the two probability 
distributions as 

p? = + (1 - p)p$ (0< M <1). (25) 

An entropic functional S({pi}) is said concave if and only if for all /i and for all 
{Pi} and {p'j} 

5(K})>^(te}) + (i-/i)^a) (26) 

By convexity we mean the same property where > is replaced by <. It can be 
easily shown that the entropy S q is concave (convex) for every {pi} and every q > 
(q < 0). It is important to stress that this property implies, in the framework of 
statistical mechanics, thermodynamic stability, i.e., stability of the system with 
regard to energetic perturbations. This means that the entropic functional is 
defined such that the stationary state (e.g., thermodynamic equilibrium) makes 
it extreme (in the present case, maximum for q > and minimum for q < 0). 
Any perturbation of {pi} which makes the entropy extreme is followed by a 
tendency toward {pi} once again. Moreover, such a property makes possible for 
two systems at different temperature to equilibrate to a common temperature. 



Stability or experimental robustness: An entropic functional S({pi}) is 
said stable or experimentally robust if and only if, for any given e > 0, exists 
8 e > such that, independently from W, 

w 

i=l 



5(fe»-5({pa) 



< e . 



(27) 
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This implies in particular that 



lim lim 

£^0 W^OC 



S({jh})-S{{jpQ) 



lim lim 

W->ooe-»0 



S({ Pi })-S(M}) 



5 li 



= . (28) 



Lesche pQ has argued that experimental robustness is a necessary requisite 
for an entropic functional to be a physical quantity because essentially assures 
that, under arbitrary small variations of the probabilities, the relative variation 
of entropy remains small. This property is to be not confused with thermody- 
namical stability, considered above. It has been shown |15| that the entropy S q 
exhibits, for any q > 0, this property. 

2.6 A remark on other possible generalizations of the 
Boltzmann-Gibbs entropy 

There have been in the past other generalizations of the BG entropy. The Renyi 
entropy is one of them and is defined as follows 



3 r ^ EZip! = Mi + (i-g )g g ] 

l-q 1-q 



S R _ *J±ZM=lVi _ ^ v 1) u q\ ^9) 



Another entropy has been introduced by Landsberg and Vedral ^3 an d 
independently by Rajagopal and Abe ^Hj- It is sometimes called normalized 
nonextensive entropy, and is defined as follows 



oN _ qLVRA _ EfaiP? _ fn n \ 

q - q l~q ~l + (l-q)S q ■ ' 



A question arises naturally: Why not using one of these entropies (or even a 
different one such as the so called escort entropy S q , defined in ^JGODj ms tead 
of S q , for generalizing BG statistical mechanics? The answer appears to be quite 
straightforward. S^, S^ VRA and are not concave nor experimentally robust. 
Neither yield they a finite entropy production for unit time, in contrast with 
S q , as we shall see later on. Moreover, these alternatives do not possess the 
suggestive structure that S q exhibits associated with the Jackson generalized 
derivative. Consequently, for thermodynamical purposes, it seems nowadays 
quite natural to consider the entropy S q as the best candidate for generalizing 
the Boltzmann-Gibbs entropy. It might be different for other purposes: for 
example, Renyi entropy is known to be useful for geometrically characterizing 
multifractals. 



3 Connection to thermodynamics 

Dozens of entropic forms have been proposed during the last decades, but not 
all of them are necessarily related to the physics of nature. Statistical mechanics 
is more than the adoption of an entropy: the (meta)equilibrium probability dis- 
tribution must not only optimize the entropy but also satisfy, in addition to the 
norm constraint, constraints on quantities such as the energy. Unfortunately, 
when the theoretical frame is generalized, it is not obvious which constraints are 
to be maintained and which ones are to be generalized, and in what manner. In 
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this section we derive, following along the lines of Gibbs, a thermodynamics for 
(meta)equilibrium distribution based on the entropy defined above, ft should 
be stressed that the distribution derived in this way for q ^ 1 does not corre- 
spond to thermal equilibrium (as addressed within the BG formalism through 
the celebrated Boltzmann's molecular chaos hypothesis) but rather to a metae- 
quilibrium or a stationary state, suitable to describe a large class of nonergodic 
systems. 



3.1 Canonical ensemble 

For a system in thermal contact with a large reservoir, and in analogy with the 
path followed by Gibbs [51 119). we look for the distribution which optimizes the 
entropy S q defined in Eq. (21), with the normalization condition (2) and the 
following constraint on the energy |19| : 



U q (31) 



where 

Pi = — (32) 

1 r> q 

is called escort distribution, and {Ei\ are the eigenvalues of the system Hamil- 
tonian with the chosen boundary conditions. Note that, in analogy with BG 
statistics, a constraint like J^i=i Pi^i = U would be more intuitive. This was 
indeed the first attempt [§], but though it correctly yields, as stationary (meta- 
cquilibrium) distribution, the g-exponential, it turns out to be inadequate for 
various reasons, including related to Levy-like superdiffusion, for which a di- 
verging second moment exists. 

Another natural choice 012] would be to fix Yli=iPi^i but, though this 
solves annoying divergences, it creates some new problems: the metaequilibrium 
distribution is not invariant under change of the zero level for the energy scale, 
Y^iLi Pi 1 implies that the constraint applied to a constant does not yield 
the same constant, and above all, the assumption pf 3 +B — pfpf and E^ +B = 
Ef-+E? does raoiyield U^ +B — llf' + U^, i.e., the energy conservation principle 
is not the same in the microscopic and macroscopic worlds. 

It is by now well established that the energy constraint must be imposed 
in the form (|31(l . using the normalized escort distribution (|32|l . A detailed 
discussion of this important point can be found in |22| . 

The optimization of S q with the constraints (2) and Q31|l with Lagrange 
multiplier /3 yields: 

[i-(i- g )/y^-Lg]^ = e -^- u «) 



Zq Z q 



with 



and 



w 



2^=1 P, 



(35) 
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It turns out that the metacquilibrium distribution can be written hidding the 
presence of U q in a form which sometimes is more convenient when we want to 
use experimental or computational data: 



[1 - (1 - q)P' q E, 
Pi = 

with 



Z' q z> q 



q (36) 



w 



Z> q = Y.*~/ qEi ( 37 ) 



and 



0o = —w (38) 

q E5iP? + (i-?W 

It can be easily checked that (i) for q — > 1, the BG weight is recovered, i.e., 
Pi = e~@ Ei / Z\, (ii) for q > 1, a power-law tail emerges, and (hi) for q < 1, the 
formalism imposes a high energy cutoff (p, = 0) whenever the argument of the 
^-exponential function becomes negative. 

Note that distribution (33) is generically not an exponential law, i.e., it is 
generically not factorizable (under sum in the argument), and nevertheless is 
invariant under choice of the zero energy for the energy spectrum (this is one of 
the pleasant facts associated with the choice of energy constraint in terms of a 
normalized distribution like the escort one). 

3.2 Legendre structure 

The Legendre-transformation structure of thermodynamics holds for every q 
(i.e., it is q-invariant) and allows us to connect the theory developed so far to 
thermodynamics. 

We verify that, for all values q, 

(r_,/ W (39 , 

Also, it can be proved that the free energy is given by 

1 



where 

Zl-o - 1 Zl~ 9 - 1 

In, Z q = -i = -i pu g , (41) 

1 — q 1-9 

and the internal energy is given by 

U g = -^ln q Z q . (42) 

Finally, the specific heat reads 

= dS q dU q d*F q 

q ~ dT - dT - dT* ■ [ ' 

In addition to the Legendre structure, many other theorems and properties 
are g-invariant, thus supporting the thesis that this is a right road for general- 
izing the BG theory. Let us briefly list some of them. 



F q = U q -TS q = --\n q Z q (40) 
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1. Boltzmann H-theorem (macroscopic time irreversibility): 

1^>0 (Vg). (44) 

This inequality has been established under a variety of irreversible time 
evolution mesoscopic equations (|23 EH) and others), and is consistent 
with the second principle of thermodynamics ("2Z|), which turns out to be 
satisfied for all values of g. 

2. Ehrenfest theorem (correspondence principle between classical and quan- 
tum mechanics) : Given an observable O and the Hamiltonian TL of the 
system, it can be shown (see |28] for unnormalized g-expectation values; 
for the normalized ones, the proof should follow along the same lines) that 

^ = 1«*. <5]>, Mtf. (45) 

3. Factorization of the likelihood function (thermodynamically independent 
systems): The likelihood function satisfies |291 1321 13*3) 

W q ({ Pi }) oc e £««ft}) . (46) 

Consequently, if A and B are two probabilistically independent systems, 
it can be verified that 

W q (A + B) = W q (A)W q (B) (Vg) , (47) 

as expected by Einstein [2] . 

4. Onsager reciprocity theorem (microscopic time reversibility): It has been 
shown 23 30 , 31 that the reciprocal linear coefficients satisfy 

L jk = L kj (Vg) , (48) 

thus satisfying the fourth principle of thermodynamics. 

5. Kramers and Kronig relations (causality): They have been proved in |23| 
for all values of q. 

6. Pesin theorem (connection between sensitivity to the initial conditions and 
the entropy production per unit time). We can define the q-generalized 
Kolmogorov-Sinai entropy as 

K„ = lim lim lim i^M (49) 

where N is the number of initial conditions, W is the number of windows 
in the partition (fine graining) we have adopted, and t is (discrete) time. 
Let us mention that the standard Kolmogorov-Sinai entropy is defined 
in a slightly different manner in the mathematical theory of nonlinear 
dynamical systems. See more details in ,33| and references therein. 

The q-generalized Lyapunov coefficient X q can be defined through the sen- 
sitivity to the initial conditions 

f= lim Ax(f)/Ax(0) = e>* (50) 

Ax(0)-+0 H 
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where we have focused on a one-dimensional system (basically x(t + 1) = 
g(x(t)), g(x) being a nonlinear function, for example that of the logistic 
map). It was conjectured in 1997 |24| . and recently proved for unimodal 
maps jSl], that they are related through 

K q = ( > ° (51) 

y [0 otherwise 

To be more explicit, we have K\ — \\ if Ai > (and K\ — if Ai < 0). 
But if we have Ai = 0, then we have a special value of q such that K q = X q 
if A g > (and K q = if \ < 0). 

Notice that the q-invariance of all the above properties is kind of natural. Indeed, 
their origins essentially lie in mechanics, and what we have generalized is not 
mechanics but only the concept of information upon it. 

4 Applications 

The ideas related with nonextensive statistical mechanics have received an enor- 
mous amount of applications in a variety of disciplines including physics, chem- 
istry, mathematics, geophysics, biology, medicine, economics, informatics, ge- 
ography, engineering, linguistics and others. For description and details about 
these, we refer the reader to [22HSE1 as well as to the bibliography in The 
a priori determination (from microscopic or mesoscopic dynamics) of the index 
q is illustrated for a sensible variety of systems in these references. This point 
obviously is a very relevant one, since otherwise the present theory would not 
be complete. 

In the present brief introduction we shall address only two types of sys- 
tems, namely a long-range-interacting many-body classical Hamiltonian, and 
the logistic-like class of one-dimensional dissipative maps. The first system is 
still under study (i.e., it is only partially understood), but we present it here 
because it might constitute a direct application of the thermodynamics devel- 
oped in the Section 3. The second system is considerably better understood, 
and illustrates the various concepts which appear to be relevant in the present 
generalization of the BG ones. 

4.1 Long-range-interacting many-body classical Hamilto- 
nians 

To illustrate this type of system, let us first focus on the inertial XY ferromag- 
netic model, characterized by the following Hamiltonian j^Hl ED] : 

«=i:|+s: 1 ""'; ( !'" 9f) «•*<>), ( 52 , 

i=i ijtj «j 

where 9i is the i — th angle and pi the conjugate variable representing the 
angular momentum (or the rotational velocity since, without loss of generality, 
unit moment of inertia is assumed). 

The summation in the potential is extended to all couples of spins (counted 
only once) and not restricted to first neighbors; for d = 1, ry = 1, 2,3, for 
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d = 2, r*y = l,\/2, 2, ...; for d = 3, r^- = 1, \/2, \/3, 2, .... The first-neighbor 
coupling constant has been assumed, without loss of generality, to be equal to 
unity. This model is an inertial version of the well known XY ferromagnet. 
Although it does not make any relevant difference, we shall assume periodic 
boundary conditions, the distance to be considered between a given pair of sites 
being the smallest one through the 2d possibilities introduced by the periodicity 
of the lattice. Notice that the two-body potential term has been written in such 
a way as to have zero energy for the global fundamental state (corresponding 
to pi = 0, Vi, and all 9i equal among them, and equal to say zero). The 
a — > oo limit corresponds to only first-neighbor interactions, whereas the a = 
limit corresponds to infinite-range interactions (a typical Mean Field situation, 
frequently referred to as the HMF model |2E])- 

The quantity N = J2i^j r iJ a corresponds essentially to the potential energy 
per rotator. This quantity, in the limit N — > oo, converges to a finite value if 
a/d > 1, and diverges like N 1 ' a / d if < a/d < 1 (like InA for a/d = 1). 
In other words, the energy is extensive for a/d > 1 and noncxtensive other- 
wise. In the extensive case (here referred to as short range interactions; also 
referred to as integrable interactions in the literature), the thermal equilibrium 
(stationary state attained in the t — > oo limit) is known to be the BG one 
(see |39|V The situation is much more subtle in the nonextensive case (long 
range interactions). It is this situation that we focus on here. N behaves like 

dr r d ~ l r~ a oc N ~ — All these three equivalent quan- 

tities (N or N 1 _a/d 1 or ~ l-a/d"^ ) are ^distinctively used in the literature 
to scale the energy per particle of such long-range systems. In order to conform 
to the most usual writing, we shall from now on replace the Hamiltonian Ti by 
the following rescaled one: 

2 — 1 l^J L J 

The molecular dynamical results associated with this Hamiltonian (now artifi- 
cially transformed into an extensive one for all values of a/d) can be trivially 
transformed into those associated with Hamiltonian TL by re-scaling time (see 

Eon. 

Hamiltonian (53) exhibits in the microcanonical case (isolated system at 
fixed total energy U) a second order phase transition at u = U/N — 0.75. It 
has anomalies both above and below this critical point. 

Above the critical point it has a Lyapunov spectrum which, in the N — > oo 
limit, approaches, for < a/d < 1, zero as N~ K , where n(a/d) decreases from 
1/3 to zero when a/d increases from zero to unity, and remains zero for a/d > 1 
|4()U41j . It has a Maxwellian distribution of velocities 02], and exhibits no aging 
gSj. Although it has no aging, the typical correlation functions depend on time 
as a g-exponential. Diffusion is shown to be of the normal type. 

Below the critical point (e.g., u — 0.69), for a nonzero-measure class of ini- 
tial conditions, a longstanding quasistationary (or metastable) state precedes 
the arrival to the BG thermal equilibrium state. The duration of this quasis- 
tationary state appears to diverge with N like N 021 HH • During this anoma- 
lous state, there is aging (the correlation functions being well reproduced by 
g-exponentials once again), and the velocity distribution is not Maxwellian, but 
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rather approaches a g-exponential function (with a cutoff at high velocities, as 
expected for any microcanonical system). Anomalous superdiffusion is shown 
to exist in this state. The mean kinetic energy (<x T, where T is referred to 
as the dynamical temperature) slowly approaches the BG value from below, the 
relaxation function being once again a ^-exponential one. During the anomalous 
aging state, the zeroth principle of thermodynamics and the basic laws of ther- 
mometry have been shown to hold as usual . The fact that such basic 
principles are preserved constitutes a major feature, pointing towards the ap- 
plicability of thermostatistical arguments and methods to this highly nontrivial 
quasistationary state. 

Although none of the above indications constitutes a proof that this long- 
range system obeys, in one way or another, nonextcnsive statistical mechanics, 
the set of so many consistent evidences may be considered as a very strong 
suggestion that so it is. Anyhow, work is in progress to verify closely this 
tempting possibility (see also |37|)- 

Similar observations are in progress for the Hcisenbcrg version of the above 
Hamiltonian 0H| > as we U as f° r a XY model including a local term which breaks 
the angular isotropy in such a way as to make the model to approach the Ising 
model P) . 

Lennard- Jones small clusters (with TV up to 14) have been numerically stud- 
ied recently |50| . The distributions of the number of local minima of the poten- 
tial energy with k neighboring saddle-points in the configurational phase space 
can, although not mentioned in the original paper |5(Jj , be quite well fitted with 
g-exponentials with q = 2. No explanation is still available for this suggestive 
fact. Qualitatively speaking, however, the fact that we are talking of very small 
clusters makes that, despite the fact that the Lennard- Jones interaction is not 
a long-range one thermodynamically speaking (since a/d = 6/3 > 1), all the 
atoms sensibly see each other, therefore fulfilling a nonextensive scenario. 

4.2 The logistic-like class of one-dimensional dissipative 
maps 

Although low-dimensional systems are often an idealized representation of phys- 
ical systems, they sometimes offer the rare opportunity to obtain analytical re- 
sults that give profound insight in the comprehension of natural phenomena. 
This is certainly the case of the logistic-like class of one-dimensional dissipative 
maps, that may be described by the iteration rule 

x t +i = /(aft) = 1 - a|a; t | z , (54) 

where x E [—1, 1], t = 0,1, ... is a discrete-time variable, a € [0, 2] is a control 
parameter, and z > 1 characterizes the universality class of the map (for z = 2 
one obtains one of the possible forms of the very well known logistic map). 
In particular, this class of maps captures the essential mechanisms of chaos 
for dissipative systems, like the period-doubling and the intermittency routes 
to chaos, and constitute a prototypical example that is reported in almost all 
textbooks in the area (see, e.g., [S3 ESI)- 

As previously reported, the usual BG formalism applies to situations where 
the dynamics of the system is sufficiently chaotic, i.e., it is characterized by 
positive Lyapunov coefficients. A central result in chaos theory, valid for several 
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Figure 1: (a) Attractor of the logistic map (z = 2) as a function of a. The edg 
of chaos is at the critical value a c = 1.401155198... (b) Lyapunov exponent A a 
a function of a. 
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classes of systems, is the identity between (the sum of positive) Lyapunov co- 
efficients and the entropy growth (for Hamiltonian systems this result is called 
Pesin theorem). The failure of the classical BG formalism and the possible valid- 
ity of the nonextensive one is related to the vanishing of the classical Lyapunov 
coefficients A = Ai and to their replacement by the generalized ones A g (see Eq. 

Reminding that the sensitivity to initial conditions of one-dimensional maps 
is associated to a single Lyapunov coefficient, the Lyapunov spectra of the lo- 
gistic map (z = 2), as a function of the parameter a, is displayed in Fig. ^ 
together with the attractor Xoo — {x £ [—1, 1] : x = lim^oo x t }. For a smaller 
than a critical value a c = 1.401155198..., a zero Lyapunov coefficient is as- 
sociated to the pitchfork bifurcations (period-doubling); while for a > a c the 
Lyapunov coefficient vanishes for example in correspondence of the tangent bi- 
furcations that generate the periodic windows inside the chaotic region. In 
Ref. [HI], using a renormalization-group (RG) analysis, it has been (exactly) 
proven that the nonextensive formalism describes the dynamics associated to 
these critical points. The sensitivity to initial conditions is in fact given by the 
g-exponential Eq. i|50|l . with q = 5/3 for pitchfork bifurcations and q — 3/2 for 
tangent bifurcations of any nonlinearity z, while X q depends on the order of the 
bifurcation. It is worthwhile to notice that these values are not deduced from 
fitting; instead, they are analytically calculated by means of the RG technique 
that describes the (universal) dynamics of these critical points. 

Perhaps the most fascinating point of the logistic map is the edge of chaos 
a = a c , that separates regular behavior from chaoticity. It is another point where 
the Lyapunov coefficient A vanishes, so that no nontrivial information about the 
dynamics is attainable using the classical approach. Nonetheless, once again the 
RG approach reveals to be extremely powerful. Let us focus, for definiteness, 
on the case of the logistic map z = 2. Using the Feigenbaum-Coullet-Tresser 
RG transformation one can in fact show (see for details) that the dy- 

namics can be described by a series of subsequences labelled by k = 0,1,..., 
characterized by the shifted iteration time tk(n) = (2k + l)2 n ~ k — 2k — 1 (n is 
a natural number satisfying n > k), that are related to the bifurcation mech- 
anism. For each of these subsequences, the sensitivity to initial conditions is 
given by the g-exponential Eq. JSUJ). The value of q (that is the same for all 
the subsequences) and Ag are deduced by one of the Feigenbaum's universal 
constant aj? = 2.50290... and are given by 

■ 0.2445... and A« = — -. (55) 



lna F ■ 9 ((2fc + l)ln2) 

In figure Fig. H£b) this function is drawn for the first subsequence (k = 0), 
together with the result of a numerical simulation. For comparison purposes, 
Fig. El^a) shows that when the map is fully chaotic £ grows exponentially with 
the iteration time, with the Lyapunov coefficient A = ln2 for a = 2. 

For the edge of chaos it is also possible to proceed a step further and consider 
the entropy production associated to an ensemble of copies of the map, set 
initially out-of-equilibrium. Remarkably enough, if (and only if) we consider the 
entropy S q precisely with q = 0.2445... for the definition of K q (see Eq. (|4*9l L 
for all the subsequences we obtain a linear dependance of S q with (shifted) time, 
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Figure 2: Sensitivity to initial conditions for the logistic map (2 = 2). The dots 
represent for two initial data started at Xq = 1/2 and x ~ 1/2 + 1CP 8 (a), 



and = and a; 



10" 



(b). For a = 2 the log- linear plot displays a linear 
increase with a slope A = In 2. For a = a c the g-log- linear plot displays a linear 
increase of the upper bound (sequence k = 0). The solid line is the function in 
Eq. with g = 0.2445... and A, = lna F /ln2 = 1.3236.... In the inset of (b) 

the same data represented in a log- log plot. 
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i.e., a generalized version of the Pesin identity: 

KW=\W. (56) 

Fig. Ell)) shows a numerical corroboration of this analytical result. The q- 
logarithm of the sensitivity to initial conditions plotted as a function of S q 
displays in fact a 45° straight line for all iteration steps. Again, Fig. Efa) 
presents the analogous result obtained for the chaotic situation a — 2 using the 
BG entropy. The inset of Fig. 02b) gives an insight of Fig. HJb), showing that 
the linearity of the g-logarithm of £ with the iteration time is valid for all the 
subsequences, once that the shifted time tk is used. 

To conclude this illustration of low-dimensional nonextensivity, it is worthy 
to explicitly mention that the nontrivial value q(z) (with q(2) — 0.2445...) can be 
obtained from microscopic dynamics through at least four different procedures. 
These are: (i) from the sensitivity to the initial conditions, as lengthily exposed 
above and in |24l 1551 IB!)] : (ii) from multifractal geometry, using 

1 1 

l-q(z) a mm (z) a max (z) In 2 

whose details can be found in |57j : (iii) from entropy production per unit time, 
as exposed above and in |84l I85| ; and (iv) from relaxation associated with the 
Lebesgue measure shrinking, as can be seen in |58j (see also |59p. 



(z — 1) lna^(z) 



5 Final remarks 

Classical thermodynamics, valid for both classical and quantum systems, is es- 
sentially based on the following principles: th principle (transitivity of the con- 
cept of thermal equilibrium), 1 st principle (conservation of the energy), 2 nd prin- 
ciple (macroscopic irreversibility), 3 rd principle (vanishing entropy at vanishing 
temperature) , and 4 th principle (reciprocity of the linear nonequilibrium coeffi- 
cients) . All these principles are since long known to be satisfied by Boltzmann- 
Gibbs statistical mechanics. However, a natural question arises: Is BG statis- 
tical mechanics the only one capable of satisfying these basic principles? The 
answer is no. Indeed, the present nonextensive statistical mechanics appears to 
also satisfy all these five principles (thermal equilibrium being generalized into 
stationary or quasistationary state or, generally speaking, metaequilibrium) , as 
we have argued along the present review. The second principle in particular has 
received very recently a new confirmation |51| . 

The connections between the BG entropy and the BG exponential energy dis- 
tribution are since long established through various standpoints, namely steepest 
descent, large numbers, microcanonical counting and variational principle. The 
corresponding q-generalization is equally available in the literature nowadays. 
Indeed, through all these procedures, the entropy S q has been connected to the 
^-exponential energy distribution, in particular in a series of works by Abe and 
Rajagopal (see |221 136j and references therein). 

In addition to all this, S q shares with the BG entropy concavity, stability, 
finitencss of the entropy production per unit time. Other well known entropies, 
such as the Renyi one for instance, do not. 

Summarizing, the dynamical scenario which emerges is that whenever er- 
godicity (or at least an ergodic sea) is present, one expects the BG concepts to 
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Figure 3: Numerical corroboration (full circles) of the generalized Pesin identity 
^ — Xq k ^ for the logistic map. On the vertical axis we plot the q-logarithm 



of ^ (equal to Xqtk) and in the horizontal axis S q (equal to K'q'tk). Dashed 
lines are linear fittings, (a) For a — 2 the identity is obtained using the BG 
formalism q — 1; while (b) at the edge of chaos q — 0.2445... must be used. 
Numerical data in (b) are obtained partitioning the interval [— 1 , 1] into cells of 
equal size 10 -9 and considering a uniform distribution of 10 5 points inside the 
interval [0, 10 -9 ] as initial ensemble; £ is calculated using, as inital conditions, 
the extremal points of this same interval. A similar setup gives the numerical 
results in (a). In the inset of (b) we plot the g-logarithm of £ as a function of 
the shifted time tk = (2fc + l)2' l ~ fe — 2k — 1. Full lines are from the analytical 
result Eq. (JHOJl. 
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be the adequate ones. But when ergodicity fails, very particularly when it does 
so in a special hierarchical (possibly multifractal) manner, one might expect the 
present nonextensive concepts to naturally take place. Furthermore, we conjec- 
ture that, in such cases, the visitation of phase space occurs through some kind 
of scale-free topology. 
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